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ABSTRACT 

In  this  paper,  we  statistically  optimize  a  well  known 
class  of  HR  two  channel  orthonormal  filter  banks 
parameterized  by  a  single  coefficient  when  subband 
quantizers  are  present.  The  optimization  procedure  is 
extremely  simple  and  very  fast  compared  for  example 
to  the  linear  programming  method  used  in  the  FIR 
case  to  achieve  similar  compaction  (coding)  gains. 
The  special  form  of  the  filters  assure  the  existence 
of  a  zero  at  tt  which  can  be  important  for  some 
wavelet  applications  and  eliminate  some  of  the  major 
concerns  that  arise  in  the  FIR  design  case.  Finally,  the 
compaction  gain  obtained  is  high  and  numerically  very 
close  to  two  (ideal  case)  for  low  pass  spectra,  high  pass 
spectra  and  certain  cases  of  multiband  spectrum.  For 
these  cases,  the  use  of  higher  order  HR  filters  does  not 
increase  the  compaction  (coding)  gain. 

1.  INTRODUCTION 

There  has  been  a  considerable  interest  in  designing 
filter  banks  while  taking  into  account  the  effect  of 
subband  quantization  [1],  [2],  [3].  Given  a  fixed  budget 
of  b  bits  for  the  subband  quantizers,  the  goal  is  to 
simultaneously  optimize  the  analysis  and  synthesis 
filters  and  to  choose  a  subband  bit  allocation  strategy 
such  that  the  average  variance  of  the  error  e(n)  at  the 
output  of  the  subband  coder  is  minimized. 

The  energy  compaction  problem.  Consider  the 
scheme  of  Fig.  1.1  which  shows  a  filter  H{e^^)  with 
input  x(n)  and  output  y(n).  The  input  x(n)  is  assumed 
to  be  a  widesense  stationary  process.  With  the  input 
power  spectral  density  Sxx{^^^)  fixed,  the  compaction 
filter  problem  is  to  find  such  that  the  variance 

of  the  output,  given  by 

<^1  =  r  5„(e^")|H(e^“)P^  (1) 

J  — TT 

is  maximized  under  the  constraint  that  is 
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a  Nyquist(M)  filter.  The  design  of  such  compaction  fil¬ 
ters  is  important  in  its  own  merit  because  of  the  usual 
question  of  finding  the  best  wavelets  for  a  given  appli¬ 
cation.  For  a  two  channel  orthonormal  filter  bank,  the 
two  problems  are  identical :  optimizing  one  of  the  sub- 
hand  filters  for  maximum  energy  compaction  is  equiv¬ 
alent  to  designing  a  two  channel  optimal  orthonormal 
subband  coder.  To  see  this,  recall  that  the  coding  gain 
[4]  of  an  orthonormal  filter  bank  under  optimum  bit  al¬ 
location  and  with  the  high  bit  rate  quantizer  assump- 

^2 

tions  is  given  by  ^sBc(2)  =  —  where  al  is  the 

input  signal  variance  and  al  is  the  variance  of  the 
kth  subband  signal.  Using  2cr|  =  -I-  ,  the  above 

expression  can  be  rewritten  as 

""  VGcomp{2)i2  -  Gccmp{2)) 

where  Gcompi"^)  Is  the  so  called  compaction  gain  and 
is  equal  to  The  compaction  gain  therefore 

uniquely  determines  the  coding  gain  of  a  2-channel 
orthonormal  subband  coder.  It  is  important  to  keep 
in  mind  that  the  maximum  possible  compaction  gain 
Gcomp(2)  is  equal  to  two  whereas  the  coding  gain 
GsbcC^)  can  be  arbitrarily  large. 

2.  THE  PROBLEM  SET  UP 

The  aim  of  this  paper  is  to  statistically  optimize  a 
two  channel  orthonormal  filter  bank  when  subband 
quantizers  are  present  at  low  cost.  Two  channel 
orthonormal  filter  banks  are  of  special  interest  because 
they  form  a  basic  building  block  in  the  design  of  wavelet 
transforms.  Low  cost  filters  are  quite  attractive  in 
image  and  audio  coding  applications.  The  requirement 
for  a  very  efficient  two  channel  system  motivates  the 
investigation  of  filter  banks  based  on  HR  filters  rather 
than  FIR  ones.  Moreover,  previous  work  on  finite 
order  compaction  filters  and/or  finite  order  two  channel 
optimum  orthonormal  filter  banks  has  been  mainly 
dedicated  to  the  FIR  case  (see  for  example  [5],  [6],  and 
[7]  to  name  a  few).  To  meet  the  above  requirements,  we 
propose  the  optimization  of  a  class  of  two  channel  HR 
orthonormal  filter  banks  based  on  the  sum  of  two  all 
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pass  filters  [8].  In  specific,  consider  the  single  coefficient 
system: 


(1) 

where  a  is  real  and  -1  <  a  <  1.  The  synthesis 
filters  are  given  by  =  HQ{e^^)  and  ^1(6-^^^)  = 

The  two  channel  system  is  sho\^Ti  in  Fig. 
2.1.  Note  that  since  the  polyphase  components  of 
the  analysis  filters  are  stable  causal  all  pass  filters, 
their  reciprocals  will  produce  unstable  synthesis  filters. 
To  overcome  this  difficulty,  Ramstad  [9]  proposed  to 
implement  the  inverse  filters  as  anti-causal  stable  HR 
filters.  Although  (1)  is  a  seemingly  restrictive  case, 
the  proposed  form  of  the  filter  Ho{z)  is  a  special  case 
of  the  more  general  structure  introduced  recently  by 
Phoong  and  al.  [10].  It  has  been  shown  that  this  type 
of  filter  provides  several  excellent  advantages  [10].  For 
example,  the  filter  Ho{z)  (and  therefore  Hi{z))  can 
have  a  very  good  frequency  response.  Furthermore,  the 
special  form  of  the  filter  assure  the  existence  of  a  zero 
at  TT  which  can  be  important  for  wavelet  applications. 
For  the  purpose  of  this  paper,  our  results  indicate  that 
for  the  cases  where  we  can  obtain  high  compaction  gain 
with  the  special  filters  in  (1),  using  higher  order  filters 
does  not  increase  the  compaction  gain. 

3.  THE  ANALYTICAL  RESULTS 

Consider  the  set  up  shown  in  Fig.  2.1.  where  the  input 
signal  x(n)  is  a  zero  mean  wide-sense  stationary  (WSS) 
random  process  with  a  power  spectrum 
Each  subband  quantizer,  labeled  by  Q,  represents  a 
scalar  uniform  (PCM)  quantizer  and  is  modeled  as 
an  additive  zero  mean  white  noise  source  q{n)  with 
variance 

a^  =  c2-^K  (1) 


filters,  say  Ho{z),  can  be  expressed  as  follows  : 

Rxxil) 


^  comp 


(2)  =  1  + 


2\  Rxx(X) 


Rxx{0) 


(2) 


The  proof  can  be  found  in  [11].  The  infinite  summation 
in  (2)  is  the  result  of  the  HR  nature  of  the  filter  bank. 
The  above  equation  was  written  specifically  in  the 
above  form  in  order  to  emphaisize  the  following  points: 
First,  when  a  is  equal  to  zero,  the  compaction  gain  is 
equal  to  1  +  RxxW/RxxiO),  which  is  simply  the  2  x  2 
KLT  compaction  gain.  This  indeed  makes  sense  since 
the  structure  of  Fig.  2.1  reduces  to  the  2  x  2  universal 
KLT.  Second,  when  the  input  signal  is  white  noise, 
i.e.  Rxx{k)  =  S{k),  the  compaction  gain  is  equal  to 
one.  Finally,  observe  that  the  above  equation  involves 
only  the  odd  samples  of  the  autocorrelation  sequence 
Rxxik)i  due  to  the  Nyquist  constraint  on 
Therefore,  if  the  input  signal  x(n)  is  such  that  its  power 
spectrum  Sxx{z)  takes  the  form  5(2^),  the  compaction 
gain  is  equal  to  unity. 

The  goal  now  is  to  find  the  optimum  coefficient  aopt 
that  maximizes  (2).  In  general,  it  is  difficult  to 
obtain  analytical  solutions  due  to  the  complexity  of 
the  expression  in  (2).  We  will  therefore  present 
analytical  solutions  for  the  optimum  coefficient  aopt, 
the  compaction  gain  Gcompi,^^  and  the  coding  gain 
GsBci^)  only  for  specific  examples  of  the  input  x{n) 
such  as  the  MA(1)  and  AR(1)  processes.  For  a  general 
random  process  a:(n),  the  optimum  coefficient  aopt  is 
obtained  numerically  through  a  MATLAB  program. 
Example  3.1.  Case  of  a  MA(1)  process.  Assume  that 
the  input  x{n)  is  a  zero  mean  MA(1)  process  with  an 
autocorrelation  sequence  in  the  form 


where  <7^  is  the  quantization  noise  variance,  c  is  a  con¬ 
stant  that  depends  on  the  statistical  distribution  of  the 
subband  signal  Xi{n)  and  the  overflow  probability,  and 
is  the  variance  of  the  ith  subband  signal.  The  sub¬ 
band  coding  problem  reduces  to  finding  the  optimum 
coefficient  aopt  that  maximizes  the  compaction  gain 
(alternatively  the  subband  variance)  at  the  output  of 
one  of  the  subband.  The  specific  form  of  the  analysis 
filters  given  in  (1)  guarantee  automatically  the  Nyquist 
property  and  transforms  the  constrained  optimization 
problem  into  an  unconstrained  one.  A  closed  form  ex¬ 
pression  for  the  compaction  gain  is  given  next. 

Proposition  1 ,  Consider  the  scheme  of  Fig.  2.1  under 
all  the  previous  filter  and  quantizer  assumptions.  The 
compaction  gain  at  the  output  of  one  of  the  subband 


{1  A:  =  0. 

I  ^  02  A:  =  l,— 1. 

0  otherwise. 

where  6  is  between  —1  and  1.  It  can  be  shown  [11] 
that,  for  this  case, 

aopt  —  0.5 

Gcomp{2)  =  1  +  5R„(1)/4/?zx(0)  (3) 

Gsbc(2)  =  l/Vl-25fiiJl)/16fi2,(0) 

It  is  interesting  to  note  that  the  optimum  coefficient 
aopt  is  independent  of  the  signal  statistics. 

Example  3.2.  Case  of  an  AR(1)  process.  Assume 
now  that  the  input  x{n)  is  a  zero  mean  AR(1)  process 
with  an  autocorrelation  sequence  in  the  form  Rxx  {k)  = 


2 


I 


■it 


where  p  is  between  —1  and  1.  It  can  be  shown  [11] 
that,  for  this  case, 

aopt  =  (1  -  \/(r+7))/p" 

Gcomp{‘2)  =  1  +  p  +  p(l  -  P^)Qop<  (4) 

QsBc{2)  =  l/-yi-p2(l  +  Q2p,(l-p2))2 

We  note  that  the  optimum  coefficient  in  this  case  is 
independent  of  the  sign  of  p,  is  always  negative  and 
between  1  —  y/2  and  -0.5  (the  ceise  where  p  =  0). 
Furthermore,  one  can  show  that  there  is  a  negligible 
loss  of  compaction  gain  even  when  aopt  is  implemented 
using  very  small  number  of  binary  shift  and  add 
operations  [11].  As  p  approaches  unity,  the  scheme  is 
asymptotically  equivalent  to  the  2x2  universal  KLT. 

4.  EXAMPLES  FOR  MORE  GENERAL  INPUTS 

We  give  several  examples  where  the  optimum  coeffi¬ 
cient  aopt  is  computed  numerically  through  a  MAT- 
LAB  program.  The  program  uses  the  compaction  gain 
expression  derived  previously  with  input  Rxx{k)  and 
output  Qopf.  Although  written  in  MATLAB,  the  pro¬ 
gram  converges  in  fractions  of  a  second.  This  is  an  or¬ 
der  of  magnitude  faster  than  linear  programming  tech¬ 
niques  used  to  design  high  order  FIR  compaction  filters 
to  achieve  similar  compaction  gain.  We  vary  the  input 
x(n)  such  that  the  povrer  spectral  density  shape  spans 
a  variety  of  choices  from  “low  pass”  to  multiband  with 
energy  concentrated  in  a  specific  region  to  multiband 
with  more  even  energy  distribution.  The  magnitude 
squared  response  of  the  optimum  HR  compaction  fil¬ 
ter  together  with  the  ideal  optimum  compaction  fil¬ 
ter  magnitude  squared  response  and  the  input  power 
spectral  density  are  shown  in  Fig.  4.1  to  Fig  4.4.  We 
adopt  the  following  convention  for  all  the  plots  :  the 
solid  curve  denotes  the  input  power  spectral  density, 
the  dash-dot  curve  denotes  the  magnitude  squared  re¬ 
sponse  of  the  optimum  IIR  compaction  filter  and  the 
dashed  curve  represents  the  magnitude  response  of 
the  ideal  optimum  compaction  filter.  This  last  curve  is 
obtained  by  optimizing  2Ln  FIR  filter  with  order  equal 
to  65  using  a  linear  programming  approach. 

5.  CONCLUDING  REMARKS 

We  have  addressed  in  this  paper  the  problem  of 
optimizing  a  two  channel  orthonormal  filter  bank 
with  a  cost  constraint  in  mind.  To  achieve  this, 
we  optimized  a  well  known  class  of  IIR  two  channel 
orthonormal  filter  banks  parameterized  by  a  single 
coefficient.  The  resulting  optimum  filter  bank  provides 
some  good  advantages  that  are  not  available  in  the 
FIR  case.  First,  the  Nyquist  property  is  satisfied 
automatically  because  of  the  special  form  of  the  filters. 
Second,  in  FIR  compaction  filter  design,  one  would 


traditionally  find  and  then  perform  a  spectral 

factorization  to  obtain  The  positivity  of 

the  solution  is  not  usually  guaranteed  and  spectral 
factorization  can  be  problematic  in  case  of  unit-circle 
zeros.  In  our  scheme,  these  concerns  do  not  exist 
since  Hq{z)  is  directly  found.  Third,  the  form  of  the 
filters  assure  the  existence  of  a  zero  at  tt  which  can  be 
important  for  some  wavelet  applications.  Fourth,  the 
filters  have  only  one  coefficient  which  can  be  quantized 
without  a  major  sacrifice  in  compaction  gain  as  we 
demonstrate  in  [11].  Finally,  the  compaction  gain 
obtained  is  high  and  very  close  to  two  (ideal  case)  for 
low  pass  spectrums,  high  pass  spectrums  and  certain 
cases  of  multiband  spectrum.  The  only  weakness  of  the 
filter  bank  under  consideration  is  its  poor  performance 
for  the  CcLse  of  general  multiband  spectrums.  This  is 
mainly  due  to  the  monotone  property  of  the  phase  of 
an  all  pass  function.  For  such  cases,  aopt  can  be  set  to 
zero  to  obtain  the  2x2  universal  KLT. 
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Fig.  1.1.  Schematic  of  the  energy  compaction  problem. 
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Fig.  2.1.  The  class  of  two  channel  orthonormal  filter  bank  under  consideration. 


Fig.  4.1.  Case  of  a  low  pass  AR(5) 
process  :  HR  compaction  gain  =  1.95, 
theoretical  compaction  gain  =  1.951 
and  HR  FB  coding  gain  =  5.00  db. 


Fig.  4.2.  Case  of  a  multiband  AR(12) 
process  :  HR  compaction  gain  =  1.951, 
theoretical  compaction  gain  =  1.97  and 
HR  FB  coding  gain  =  5.14  db. 


normalized  frequency 


Fig.  4.3.  Case  of  a  multiband  AR(IO) 
process  :  HR  compaction  gain  =  1.52, 
theoretical  compaction  gain  =1.61 
and  HR  FB  coding  gain  =  0.68  db. 
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Fig.  4.4.  Case  of  a  multiband  AR(5) 
process  :  HR  compaction  gain  =  1.387, 
theoretical  compaction  gain  =  1.6  and 
HR  FB  coding  gain  =  0.35  db. 


